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ABSTRACT 


Given the current focus on school evaluation and accountability, it is 
vitally important to capture those differences among schools that can 
be expected to contribute to student success as measured by students’ 
behavioral, emotional, and academic outcomes. The current practice 
of comparing “district” and “charter” schools, for example, or “public” 
and “private” schools, obscures the more important differences that such 
schools may have and does not provide a basis for substantive conclusions. 


To truly understand school differences, we must go beyond the surface of 
simple governance issues to consider how, at a deeper level, schools differ 
from one another. This paper presents the results from an extensive review 
of schools (district, chartered, and private) and the school effectiveness 
research. Potentially important differences among schools are highlighted 
and the implications of these findings are discussed. 
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Introduction 


Background 

In recent years, educational researchers interested 
in comparing schools have conducted studies aimed at 
establishing whether certain types of schools are ben- 
eficial in terms of students’ behavioral, motivational or 
academic outcomes. Unfortunately, the vast majority 
of these studies base their comparisons upon school 
governance (e.g., “charter vs. district”, or “public vs. 
private”). This sort of approach is seen in a set of arti- 
cles in the Fall 2005 issue of Education Next (www.ed- 
ucationnext.org), in which chartered and district-run 
schools are compared with little consideration of how 
the schools themselves actually differ (e.g., Bifulco & 
Ladd, 2005; Hoxby & Rockoff, 2005). In one exam- 
ple, it is only noted that the chartered schools “feature 
a structured school day and curriculum, combined 
with a family-oriented approach designed to get par- 
ents involved” (Hoxby & Rockoff, 
2005, p. 53). This approach does 
not take into account differences 
in schools’ structure and opera- 
tion, and, as a result, it is difficult 
to draw lessons from this research 
that would enlighten public poli- 
cy or guide school reform efforts. 
Unfortunately, much of the current 
educational research on the char- 
tering phenomenon suffers from 
this merit (e.g., Greene, Foster, effo rts. 
& Winters, 2003; Schneider, Buck- 
ley, & Kacsova, 2003; Solmon & Goldschmidt, 2004). 
Some researchers have identified this issue and hinted 
at solutions (e.g., Gill, Timpane, Ross, & Brewer, 2001; 
Zimmer et al., 2003), but thus far, no definitive action 
as been taken. 

When evaluating schools, we must go beyond the 
surface of simple jurisdictional labels to consider how, 
at a deeper level, schools differ from one another. Even 
a brief review of the various types of schools around 
the country would reveal significant differences in 
learning models, administration, facilities and resourc- 
es, especially when examining secondary schools. 
Rather than being a basis for comparing schools, char- 
tering or private schooling are only the mechanisms 


that enable educational innovation to arise. It is the in- 
novations, not the mode of governance, which should 
be the target of our research efforts. To do this, a more 
detailed categorization scheme for schools is required. 


Purpose 

Our purpose is to develop a more detailed classi- 
fication system for schools (a “taxonomy of schools”, 
similar to the taxonomical systems that are used to 
classify the earth’s flora and fauna, for example). The 
first step in this process is the development of a de- 
scriptive framework that captures the key structural 
and operational differences among schools that are 
anticipated to impact student outcomes. This paper 
represents our work thus far on this critical first step. 

Our goal with the initial descriptive framework is 
to encompass all of the key characteristics of schools 


When evaluating schools, we must go 
beyond the surface of simple jurisdictional 
labels to consider how, at a deeper level, 
schools differ from one another... It is the 
innovations, not the mode of governance, 
which should be the target of our research 


that could potentially impact student performance. 
We also intend for it to be relatively straightforward 
for a school leader or observer to objectively evalu- 
ate a school according to this framework, in that no 
complex estimating or analysis should be required and 
no subjective opinions should be necessary. The key 
characteristics of schools should be those that are ac- 
cessible to the levers of educational policy, and should 
be measurable with one or more dichotomous, cate- 
gorical, or quantitative variables. Finally, the variables 
in this framework should be orthogonal, to eliminate 
duplication in measurement. Although this last goal 
may not be attainable, that should not prevent us from 
using it to guide the development of our framework. 


This framework is not a classification scheme for 
schools in and of itself. Rather, it is merely the first step 
in the process of developing such a classification. Sub- 
sequent steps include (1) the measurement of a large 
number of schools using the variables from this frame- 
work, and then (2) subjecting the resulting dataset to 
cluster analysis, which will group the schools accord- 
ing to their similarities. From this, the taxonomy will 
arise empirically (Bailey, 1994). A taxonomy created in 
this fashion will be empirical, in contrast to current ef- 
forts that rely on theory or supposition. 


School effectiveness 

A great deal of existing research on school effec- 
tiveness has been done, and some of it is cited in this 
paper. As useful as this research may be, the various 
differences between schools are generally analyzed in 
isolation from one another, preventing an integration 
of knowledge. With a taxonomy, the differences be- 
tween schools can be examined in a broader context, 
either by comparing across taxonomical categories or 
by analyzing subtle variations within categories. 

It should be noted that the extant research cited in 
this paper has produced a staggering number of vari- 
ables with which to measure and evaluate schools. It 
follows that a taxonomical system, which is by defi- 
nition a form of data reduction, would bring needed 
clarity to the field. In the development of this taxono- 
my, our task is to identify those fundamental variables 
that should form the basis for the taxonomy and those 
that simply represent minor variations within taxo- 
nomical categories. 


Scope of work 

When discussing the evaluation and comparison 
of “schools”, we should be clear on what defines a 
“school”. For our purposes, a school is defined as any 
organized, long-term program of learning activities 
made available to a broad population of children and 
adolescents. This definition could include everything 
from large comprehensive high schools to small, per- 
sonalized charter schools to virtual schools in which 
the only connection between students and teachers is 
via the Internet. Our framework is intended to include 
both public and private schools, but is not intended to 
include homeschooling, which is generally less orga- 
nized than formal schooling and not made available to 
a broad population. Finally, our focus in this project is 


on secondary schools, given that we expect most of 
the variation among schools to be found at the sec- 
ondary school level. Variation does exist at the pri- 
mary school level, but many of these schools fall into 
fairly well-defined categories. For example, many el- 
ementary schools choose to implement a set curric- 
ulum across the school (e.g., Open Court, Houghton 
Mifflin, etc.) or follow a set philosophy (e.g., Montes- 
sori, Waldorf, Individually Guided Education, etc.). 

The variables in this framework have come from 
a variety of sources. Some have been part of the 
empirical literature for some time (and if so, the cor- 
responding references will be noted). Other variables 
were derived from school visits, in which new innova- 
tions or ideas were observed. It should be emphasized 
that these variables are meant to represent variation at 
the school level. In other words, they are meant to be 
structural and organizational qualities of schools that 
are implemented in a more or less consistent fashion 
throughout the school. Classroom-level variations, 
such as a teacher's personal instructional techniques 
(e.g., lecture vs. hands-on activities), or the nature of 
a teacher's assessment practices (e.g., multiple-choice 
vs. essay questions), are beyond the scope of this 
project. 

In addition, student characteristics, such as age, 
gender, ethnicity, socio-economic status, and special 
education status are extremely important and have 
been shown to have a significant impact on school 
success; however, we do not consider them to be 
part of a school’s structure or operation and thus they 
are outside the scope of this framework. Instead, we 
believe that student characteristics will likely interact 
with the variables in this framework in ways that are 
deserving of further research. In other words, student 
characteristics will likely “moderate” the impact of the 
variables in the framework on school success. Thus, 
the goal of our overall research effort is to discover not 
only “what works” in terms of school features, but also 
“for whom’. 


Descriptive Framework 


Our descriptive framework includes a series of school characteristics that 
fall into three broad categories: (1) learning model, (2) administration, and 
(3) facilities and resources. There are also aspects of this framework that 
are (4) not yet included. Either these are difficult to measure according to 
what we currently understand or we may be undecided about whether 
the characteristic is inside or outside of our scope. 


For each of each of these four categories we provide below an overall 
description of the category, a set of subcategories within that category, 
and a table of specific variables within each subcategory. 


Learning Model 


These characteristics refer to the learning program in the school, which 
can have perhaps the most direct impact on student achievement. The 
chartered school phenomenon has introduced a great deal of variation 
into learning models, although a chartered school by no means can be 
assumed to be different from a traditional district-run school. At the 
same time, many district-run schools are experimenting with alternative 
pedagogies. As a result, when comparing schools, it is vitally important 
to capture the difference in learning models. 


Curriculum 


Curricula can vary significantly from school to school. Some, such as the KIPP schools, are highly structured, 
constrained, and cohort-paced with no integrative themes. Others, such as the Big Picture Company 
schools, are mostly open, with a differentiated course offering, an individual pace, and an individual 
learning plan for each student. When examining in the differences among schools, this is perhaps the 
most important set of variables to capture. The variables are presented below in Table 1. 


NF]e)(- en GLUT Lol] Ul anlaasit-1as%em\s-lal-le) ists 


Relevant 
References 


Variable Type Description 


- Highly structured: exclusively course-based following 
a set curriculum 

- Somewhat structured: mostly or all course-based, but 
course formats permit student to execute some disci- 

Aen ae plinary projects; or, school requires a senior project 

Categorical - Mixed: students spend some time in classes and some 
time working on interdisciplinary projects (note: the 
ratio of time in classes to time in projects may change 
as students get older) 

- Mostly open: most learning is based upon interdisci- 
plinary projects, with courses provided as needed 


Blumenfeld et 
al., 1991; Brown, 
Collins, & 
Duguid, 1989; 
Dochy, Segers, 
Van den Boss- 
che, & Gijbels, 
2003 


Structure 
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- Differentiated: school makes an effort to offer a wide 


variety of coursework to suit individual skill levels Lee, Chow- 
Course Dich and interests Hoy, Burkam, 
Offerings ee romot - Constrained: school deliberately limits the number Geverdt, & 
of course offerings to ensure that all students are Smerdon, 1998 
exposed to the same curriculum 
: - Yes: Aconcerted effort is made at the school level to Newmann, 
Authentic 
Dichotomous design and implement an authentic pedagogy Bryk, & Nagao- 
Pedagogy - No: No effort is made at the school level ka, 2001 
Common Ouaniieive The amount of collaborative planning time for school Louis, Marks, & 
Planning Time staff per week Kruse, 1996 
- Yes: school makes use of school-wide curricular 
themes under which traditional subjects can be 
Curricular : integrated; these themes could be centered around 
Dichotomous : 
Themes performing arts or have a cultural focus (e.g., dance, 
music, Latino culture, etc.) 
- No: school-wide themes are not used 
- Yes: each student has own individual learning plan 
individual or something akin to it that is regularly reviewed and 
, Dichotomous updated with students personal goals 
Learning Plan - No: no formal mechanism for the development and 
review of individual-level learning plans 
- Cohort: Students proceed through school at the same 
pace, as a cohort 
Pace Dichotomous - Individual: Students are permitted to work at their 


own pace and only advance when they have complet- 
ed the required work 


Assessment of Learning 


Many different types of assessment practices can be found in different schools. In most traditional schools, 
grades and teacher-created tests are the final measure of student learning, while many project-based 
schools offer grades as an option, with most assessment done via student performance (i.e., presentation, 
live experiment, etc.). These performance assessments can be related to a specific task or project, or 
they can be done periodically to assess the overall progress of student learning (e.g., the “TPOL’ at High 
Tech High in San Diego and Redwood City, CA). 


In some cases, grades are assigned but not shared with the student (e.g., Urban Academy in San Francisco, 
CA); grades are only shared with the student when they begin applying to post-secondary education. 
Finally, many schools now include self-reflection as an important part of student assessment. The variables 
are presented below in Table 2. 


Table2 Assessment-related Variables 


ae Relevant 
Variable Type Description 
YP P References 
- Optional: grades can be provided if the student de- 
sires them Goumgion 
Grsdes Categorical - Secret: grades are used but are not shared with the 2000: Elliot & 
student until they leave the school Heese 1985 
- Shared: grades are assigned and are shared with the ; 
student periodically 
- Task-related: performance assessments are used to 
assess student learning in conjunction with a learning 
Performance cases 5 ee 
iN t Categorical - Periodic: performance assessments are used peri- Wiggins, 1998 
pee ee te odically (e.g., yearly) to assess the overall progress of 
student learning 
- No: performance assessments are not used 
a oe - Yes: student self-evaluation or reflection are part of Camwell, 2005: 
Relectian Dichotomous the assessment process Marchel 2004 
- No: teacher is only evaluator of student learning ; 
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Place and Time 


Although many schools conduct all learning activities on-site, other schools permit students to engage 
in learning activities at home for some or most of the week. These in-home activities are often facilitated 
by some form of communications technology, particularly the Internet. Schools may also include a service or 
internship component in their learning model. In this case, students spend some time during the school 
week off-site at a place of business, during which time they can gain experience and insight into certain 
fields of work. Determining the amount of time students spend in different locations during an average 
week is vital to understanding how a school functions. 


In addition, while many district-run schools have a standard length to the school day and year, some 
schools have implemented either longer school days or included more days in the school year, or both. 
At the same time, the daily schedule of a school can be structured (i.e., standard-length classes or block 
scheduling) or open (i.e., no set schedule). The variables are presented below in Table 3. 


Table 3 Place-and-Time-related Variables 


Relevant 
Nelkelaslarersts 


Variable Type Description 


1. On-site: percent time students spend at the 
school 

2. At home: percent time students spend at home 

3. Service Learning: percent time students spend at 
a school-approved service learning or internship 
site 


Calabrese & 
Schumer, 1986; 
Hamilton & Fenzel, 
1988; Yates & 
Youniss, 1996 


Place Quantitative (3) 


' ; Gere 1. Hours per school week Caldwell, Huitt, & 
Learning Time | Quantitative (2) 2. Weeks per school year Graeber, 1982 
- Set schedule/standard class periods Dexter, Tai, & 
- Set schedule/block scheduling Sadler, 2006; 
Daily Schedule | Categorical - Open schedule/set hours Lawrence & 
- Open schedule/variable hours McPherson, 2000; 


Nichols, 2005 
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Teacher-to-student Programs 


These innovations don't directly impact the learning environment, but do impact the relationship between 
teachers and students, which can then impact student performance (Connell & Wellborn, 1991; Goodenow, 
1993; Ryan & Grolnick, 1986; Ryan, Stiller, & Lynch, 1994; Voelkl, 1995; Wentzel, 1994, 1997, 1998). 


One example, known as advisory grouping, assigns students to an advisor upon entry to a school and 
the students meet periodically with that advisor throughout their time in school. Each teacher in the 
school acts as an advisor and is responsible for anywhere from 10 to 18 or more students. This practice 
can also be known as a “long-term homeroom’. 


If it exists, the advisory group can be somewhat peripheral to the learning environment, in which case 
a student may meet with their advisor once or twice a week, or the advisory group can be the basis for 
all activities in school. In the latter case, a student may spend most or all of their time working in their 
advisory group. 


Looping also provides an opportunity for the development of positive relationships between teachers 
and students, but involves the scheduling of classes such that a teacher will have a particular group of 
students for more than one year. The variables are presented below in Table 4. 


Table 4 Teacher-to-Student-related Variables 


: a Relevant 
Variable Type Description pees 
- None: school does not use advisory grouping 
- Limited: school does use advisory grouping, but 
Advisory students only meet in their advisory once or twice Lee & Smith, 1995; 
: Categorical a week Maclver & Epstein, 
Grouping - Extensive: students spend a majority of their time 1991; Newell, 2003 
working with their advisor or in their advisory 
group 
L : P - Yes: school uses looping ; 
ooping Dichotomous Nescchecia Yamauchi, 2003 
- No: school does not use looping 


Student-to-student Programs 


Some schools have implemented programs targeted at improving peer relations in school or raising 
test scores, or both. Example programs could include a student tutoring program, a mentoring program 


between older and younger students, or a conflict resolution program. The variables are presented below 
in Table 5. 


Table5 Student-to-Student-related Variables 
Relevant 
Variable Type Description 
YP P References 
- Yes: School officially organizes a Abbott, Greenwood, Buzhardt, & 
Sident student tutoring program Tapia, 2006; Heron, Villareal, Yao, 
ree DichGtoaiaus - No: no tutoring program Christianson, & Heron, 2006; 
P 8 Maheady, Mallette, & Harper, 
rogram. 2006; McMaster, Fuchs, & Fuchs, 
2006 
- Yes: School officially organizes a Helaner suguse & Realm 
Student student mentoring program or bud- 
: : to, 2003 (elementary school); 
Mentoring Dichotomous dy system . 
: Lane-Garon & Richardson, 2003 
Program - No: no tutoring program or buddy (Clementi echoull 
system 
re - Yes: School officially organizes a Stevahn, Johnson, Johnson, 
ese: Dichotomous student conflict resolution program Green, & Laginski, 1997; Stevahn, 
Resolution - No: no conflict resolution program Johnson, Johnson, & Real, 1996 
Program 
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Other Variables 


Learning-related variables that are sometimes used in school evaluation include the availability of 
Advanced Placement (AP) courses and/or International Baccalaureate (IB) certification, whether ability 


grouping or tracking is used, whether cooperative learning is adopted as part of the learning model, 


whether the curriculum has a central focus of some kind (e.g., culture or arts), how teachers are 
addressed (i.e., first vs. last name), and whether instruction is provided in multiple languages. The 


variables are presented below in Table 6. 


Table6 Other Learning-related Variables 
are Relevant 
Variable Type DY eal olireya) 
YP P References 
1. AP: the number of AP classes available at the school Shaunessy, 
AP/IB Guanuitve 0) 2. IB: the number of IB classes available at the school Suldo, Hard- 
Offerings esty, & Shaf- 
fer, 2006 
- Yes: school makes use of ability grouping or tracking Gamoran, 
- No: ability grouping is not used 1992; Hallinan, 
ili ‘ : 
Abi ity Eictoreaas 1994; Mulkey, 
Grouping Catsambis, 
Steelman, & 
Crain, 2005 
- Yes: school formally adopts cooperative learning as DeVries & 
an integral part of the learning model Slavin, 1978; 
- No: no formal adoption of cooperative learning Johnson, 
Johnson, & 
Holubec, 
Cooperative Dichoromeus 1984; Johnson, 
Learning Maruyama, 
Johnson, Nel- 
son, & Skon, 
1981; Sharan & 
Shaulov, 1990; 
Slavin, 1977 
- Yes: school formally adopts an arts focus within the 
i : Gamwell, 
Arts Focus Dichotomous curriculum 2005 
- No: no formal focus on the arts in the curriculum 
- Yes: school formally adopts a cultural focus within the 
Cultural Focus | Dichotomous curriculum 
- No: no formal focus on culture in the curriculum 
- Yes: school provides instruction in multiple languages Martin, 1997; 
Multi- : - No: instruction only provided in English Schechter & 
: : Dichotomous : 
lingualism Cummins, 
2003 
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Administration 


These characteristics refer to the way in which the school is run on 

a day-to-day or year-to-year basis (i.e., who makes decisions, what 
type of decisions, and who is involved in the decision-making process). 
As with learning models, the chartered school phenomenon has 
introduced a great deal of variation into school administration. These 
variables can have a strong impact on the role of the teacher in the 
school, the composition of the school staff, and student attitudes 
about the school. 


School Management 


District-run schools are generally under the control of district personnel. Mandates regarding curriculum, 
personnel, scheduling, and finances are often given to the school by the district. Charter schools, on 
the other hand, are generally autonomous in their operations and have wide-ranging control over their 
school operations. 


One exception to this is chartered schools that are set up as district instrumentalities. In some cases, 
these schools are given complete decision-making authority at the school level, but in other cases these 
instrumentality schools are more like traditional district-run schools in that they have little or no autonomy. 
A situation may also exist in which some school-level decision-making is allowed but only within the 
confines presented by the school district. 


Another exception may arise in conjunction with Education Management Organizations (EMO’s). 
Different EMO’s allocate differing levels of decision-making authority to their schools, with some 
EMO’s managing their schools closely and others only providing peripheral supervision. Capturing the 
level at which important decisions are made (i.e., inside or outside the school, or some combination 
of the two) and the nature of any external affiliations is vital to understanding how a school functions. 


Within the school, many district-run schools have a principal, either dedicated to that school or, in the 
case of small rural schools, shared among several schools. Some newer schools, in contrast, do not 
have a principal and are managed by the collaborative effort of the teachers (Education|Evolving, 2006). 
This type of management model has been labeled “Teacher in Professional Practice” or “TPP”. In this 
model, the teachers as a group have responsibility for hiring and firing staff, managing the budget, and 
determining the school’s pedagogy. 


In situations where the school is led by a principal who has authority over staffing and budget affairs, 
there may also exist a senior teacher who has authority over the learning model and curriculum. In most 
cases, this senior teacher is subordinate to the principal, but occasionally this situation is reversed. The 
variables are presented below in Table 7. 


Table 7 School Management-related Variables 


nee Relevant 
Variable Type Description ve Abe 
- Independent: school has no external affiliations Brown, Henig, 
- District: school is affiliated with a school district Lacireno-Paquet, 
- Non-profit: school is affiliated with a non-profit & Holyoke, 2004; 
External C eal institution Christman, Gold, 
Affiliation #iegOnca - For-profit: school is affiliated with a for-profit & Herold, 2006; 
institution Lacireno-Paquet, 
Holyoke, Henig, 
& Moser, 2002 
1. Budget: whether final decision-making author- 
ity regarding school budget resides within or 
outside of the school 
2. Pedagogy/curriculum: whether final deci- 
School sion-making authority regarding pedagogical 


Autonomy Dichotomous (3) practice and curriculum resides within or out- 


side of the school 

Staffing: whether final decision-making authori- 
ty regarding staffing resides within or outside of 
the school 


w 


- Administrator-dominant: school is led by a prin- 
cipal, who has decision-making authority in all 
matters including instruction 

- Administrator-dominant with senior teacher(s): 
school is led by a principal, but pedagogy/cur- 


riculum is managed by a senior teacher or group Education|Evolv- 
of teachers ing, 2006; Spill- 
School a ea) - Distributed leadership: school is led by a princi- ane & Camburn, 
Leadership Boers pal, but many decisions (curriculum, budget) are 2006; Spillane, 
delegated to teachers Halverson, & 
- Senior teacher with administrator: Senior teach- Diamond, 2004 


er has decision-making authority for all matters, 
but has subordinate administrator 

- Teacher professional practice: school is led by 
the teachers, who as a group have full responsi- 
bility for the school 
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Teacher Development 


Many school leaders believe that the quality of the teaching staff is the most important factor in the 
success of the school. Activities that promote the development of school staff can lead to more positive 


student outcomes. The variables are presented below in Table 8. 


Table 8 Teacher Development-related Variables 
ofr Relevant 
Variable Type Description Bere noes 
1. Reform vs. traditional: the format of the develop- 
ment program 
2. Duration: total number of contact hours and time- 
frame for program Desimone, Por- 
3. Collective participation: whether groups of teachers ter, Garet, Yoon, 
from the same school, department, or grade level & Birman, 2002; 
Quantitative/ participate in development activities at the same Garet, Porter, 
Professional Richataneeee time Desimone, 
Development 6) 4. Active learning: whether the development program Birman, & Yoon, 
provides the opportunity for active engagement in 2001; Odden, Ar- 
learning chibald, Ferman- 
5. Coherence: whether the development activity ich, & Gallagher, 
incorporates experiences that are consistent with 2002 
teachers’ goals and aligned with state standards 
6. Content focus: whether the development activity is 
focused on deepening teachers’ content knowledge 
Coaching/ - Yes: School has an official program in which more 
Mentoring Bichorenioue experience teachers coach or mentor less experi- Portner, 2005 
enced teachers 
Program - No: school has no such program 
- Yes: School has an official program in which teach- 
Boohasaan ic oromGus ers are evaluated according to a defined rubric or Pianta, La Paro, & 
criteria Hamre, 2005 
- No: school has no official program 
- Yes: School has a differential pay program in which 
teachers are paid based upon performance and/or Odden, Kelley, 
Teacher Pay Dichotomous specialization Heneman, & Mi- 
- No: school implements a uniform pay scale for all lanowski, 2001 
teachers 
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Student Involvement 


Most schools place all decision-making authority with adults in the school (i.e., the principal, teachers, 
or other administrative staff members). A student government or student council may exist, but generally 
does not have a voice in school-level management issues; rather, these student groups are usually limited 
to issues like yearbooks and school dances. 


Other schools, in contrast, assemble a governmental body or congress of students, and this body 
participates in school-level decision-making as an equal partner. This could be a group of students 
elected by their peers or it could be comprised of the entire student body. 


In terms of rule-setting and student discipline, most schools, especially district-run schools, handle 
this through an assistant principal or some sort of dedicated staff member. Other schools, in contrast, 
assemble a student court to deal with student infractions or adjudicate disputes among students. The 
variables are presented below in Table 9. 


Ne ]e)(-mc Memes) AU [o(=1al mi lance) hViclaalslal mage telkavem\sclatelel(as 


elNVeclale 
References 


Variable Type Description 


- Total responsibility: Students create/modify school 
rules 

- Participatory: Students participate in the process of 
creating/modifying school rules 

- None: Students have no role in creating/modifying 
school rules 


Creation of 


ules Categorical 


- Yes: school makes use of a student court to deal 
with student infractions of the rules or adjudicate 
student disputes 

- No: student court is not used (an administrator, 
such as assistant principal, deals with disciplinary 
issues) 


Student Court Dichotomous 


- Yes: students participate in the process of creating 
Budget Dichotomous the school budget 
- No: students do not participate 


- Yes: students participate in the process of deter- 
Staffing Dichotomous mining whether to retain school staff 
- No: students do not participate 
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Parental Involvement 


Some schools, especially newer schools, have experimented with a signed parental compact as 
a precondition for enrollment. This compact oftentimes states a number of hours that parents are 
expected to volunteer at the school during the course of the school year, or the nature of the role that 
the parent is expected to fulfill in relation to their child’s education. Parents that fail to meet the terms 
of this compact are sometime “prevented” (or strongly discouraged) from enrolling their child in school 
the following year. 


At the same time, some schools have official policies regarding how often a teacher is expected to contact 
each student's parents during the course of the school year. Most often, the topic for these parental 
contacts is the student's academic progress. The variables are presented below in Table 10. 


Table 10 Parent Involvement-related Variables 


Relevant 
Variable Type Description 
yp P References 
Parental - Yes: school requires parents to volunteer as a con- 
Compact - Dichotomous dition of enrollment 
Volunteer - No: no volunteer requirement 
Parental - Yes: school requires parents to ensure students 


spend a certain number of hours on their home- 


Comma " Dichotomous work each night as a condition of enrollment 
Homewor - No: no homework requirement 

Parental - Yes: school requires parents to actively enforce 
Compact - Dichotomous school behavior and discipline policies 
Discipline - No: no discipline requirement 

Paral For those schools that have an official policy for pa- 


Quantitative rental contact, this is the required number of contacts 


ne that teacher must make with parents each school year 
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Measuring Success 


By understanding how a school measures their own success, a researcher gains new insight into the 
goals of the school and the outcomes that are valued by the school’s leaders. Most schools evaluate 
themselves in terms of standardized test scores and attendance, but many newer schools, especially 
chartered schools with rigorous sponsor contracts, are evaluated based upon factors such as attendance, 
graduate rates, disciplinary referrals, school safety, parent satisfaction, and fiscal soundness. The variables 
are presented below in Table 11. 


Table 11 Measuring Success-related Variables 


elNVeclale 


Variable Type Description References 


- Yes: School uses attendance as a measure of suc- 
cess 

- No: School does not use attendance as a measure 
of success 


Attendance Dichotomous 


- Yes: School uses graduation rate as a measure of 
SUCCESS 

- No: School does not use graduation rate as a mea- 
sure of success 


Graduate Rate Dichotomous 


- Yes: School uses (lack of) disciplinary referrals as a 
measure of success 

- No: School does not use disciplinary referrals as a 
measure of success 


Disciplinary 


he ale Dichotomous 


- Yes: School uses student safety as a measure of 
SUCCESS 

- No: School does not use student safety as a mea- 
sure of success 


School Safety Dichotomous 


- Yes: School uses parent satisfaction as a measure of 


Parent Dichiseisous success 
Satisfaction - No: School does not use parent satisfaction as a 
measure of success 
- Yes: School uses fiscal soundness as a measure of 
Fiscal : success 
Soundness Dichotomous - No: School does not use fiscal soundness as a mea- 


sure of success 
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Other Variables 


Administration-related variables that are traditionally used in school evaluation include financial 
expenditures (i.e., dollars per student and/or percent of budget spent on instruction), the nature of the 
staff (i.e., years of experience, the percentage holding advanced degrees, and the percentage holding 
state and/or national board certification), the number and nature of any school-community partnerships, 
the presence or absence of admissions requirements and the presence or absence of a policy on school 


uniforms. The variables are presented below in Table 12. 


Table 12 Other Administration-related Variables 
; Eo: Relevant 
Variable Type BY-rorg] oliteya) 
yp P References 
1. Expenditures: Total dollar amount per student Cici, Papierno, & 
2. Efficiency: Percent of budget spent directly on Mueller-Johnson, 
instruction 2002; Goertz & 
ee Quantitative (2) Stiefel, 1998; Gre- 
a enwald, Hedges, 
& Laine, 1996; 
Hanushek, 1996 
Number of students per teacher or average class Betts & Shkol- 
size nik, 1999; Pong & 
Pallas, 2001; Rivkin, 
Staff Size Quantitative Hanushek, & Kain, 
2005; Wright, 
Horn, & Sanders, 
1997 
1. Average years of experience Ghaith & Yaghi 
2. Percent of staff with advanced degree (ie., : pee 
Teacher rare M.Ed.) ey Om bon 
; : Quantitative (4) cea , : : 1991; Palmer, 
Qualifications 3. Percent of teachers with state certification Suck Burdens 
4. Percent of teachers with National Board Certi- a l : 
Geatii & Gonzales, 2005 
1. Athletics: school does or does have a relation- 
ship with this sort of community organization 
2. Trade/vocational: school does or does have a BawilignesComcs 
School- relationship with this sort of community orga- 
: ; ee 2001; Hands, 2005; 
Community Dichotomous (?) nization : 
; : : Ouellette, Briscoe, 
Partnerships 3. College/university: school does or does have a 
: ee 5 : & Tyson, 2004 
relationship with this sort of community orga- 
nization 
4. Other? 
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Admissions 


- Restricted: school has official requirements for 


admission (generally based upon academics) 


- Open with Screening: school has no official 


admissions requirements, but does conduct 


Policy Categorical extensive screening interviews with applicants 
to determine their suitability to the school 
- Open: school has no admissions requirements 
or screening process for new applicants 
SHG - Yes: school has a uniform policy (or a policy on Alleyne, LaPoint, 
iiss Dichotomous clothing) that applies to all students Lee, & Mitchell, 


- No: no policy exists 


2003; Bodine, 2003 
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Facilities and Resources 


These variables refer to the nature of the facility in which the 
school is located and the resources that are available to students. 
This is one of the more dramatic differences among district-run, 
private and chartered schools. District and private schools often 
have their own facility designed specifically for their learning model, 
whereas new chartered schools often have to make do with shared 
space, occasionally in office buildings or other non-standard settings. 
These issues can have a strong impact on the finances of the school 
and the safety and security of the school environment. In addition, 
if teachers and staff have to spend large amounts of time dealing with 
facility-related issues, then there is less time for group and individual 
planning, which can impact the quality of the learning environment. 


School Building 


Some schools (in fact, nearly all district-run schools) reside in their own facility, and generally this facility 
has been designed specifically for educational purposes. In contrast, some chartered schools, especially 
small schools, share space with other schools, albeit in actual school buildings. Beyond this, some chartered 
schools even share space with other types of organizations in other types of structures that were not 
originally intended to house schools. For example, River Heights Charter School in West St. Paul, MN, 
rents space in an office building, while Valley New School in Appleton, WI, is located in a downtown 
retail center. 


Most district-run schools and some chartered schools own their own facility (or, more accurately, the facility 
is owned by the managing district), whereas other chartered schools lease space. Leasing arrangement could 
be undertaken with a school district for a standard school building, or, in the case of a shared-alternative 
location, could be undertaken with any sort of landlord. The variables are presented below in Table 13. 
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Table 13. School Building-related Variables 


Variable Type 


- Traditional: school resides in a traditional facility 


elNeclale 


DY =rxel al evitoya 
B References 


with classrooms, hallways, etc. 


Scoemeon Dichotomous - Alternative: school resides in a non-traditional 
facility, without classrooms or hallways 
: - Private: a school resides by itself in a facility 
Becupany Dichotomous - Shared: a school shares a facility 
- Owned: a school owns the facility in which it re- 
Ownership Dichotomous sides 


- Leased: a school leases a facility 
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School Status 


When a school is created, it can be created as a wholly new entity or it can be created out of an existing 
school. When an existing district-run school is given a chartered status, it is referred to as a “converted” 
school. A converted school generally remains in the same school building with mostly the same 
administration and staff, but is some cases a single large district-run school can be converted to 
several smaller chartered schools that share the building. 


A school that is closed and then re-opened with a wholly new administration and/or staff is referred to as 
a “reconstituted” school. Schools that are reconstituted generally remain under district control, although 
this is not always the case; occasionally, a school can be reconstituted and converted to chartered status 
at the same time. Reconstituted schools generally remain the same size and are usually located in the 
same building. 


For schools that are new or have recently undergone a change in status, the first few years are critical; 
if routines emerge and a culture is established, the school can grow and mature, and student success 
should follow. Even the most successful new schools, though, can require several years to stabilize and 
mature. As a result, the first few years of a school’s existence may not be representative of the school’s 
proficiency or potential, and researchers should be wary of drawing substantive conclusions during this 
time. The variables are presented below in Table 14. 


Table 14 School Status-related Variables 


Relevant 
References 


Variable Type DY elg] olateya 


- New: school was created as a wholly new entity 

- Converted: existing district-run school was con- 
verted to chartered status 

Scheel - Reconstituted: existing district-run school was re- 

Categorical constituted with a new administration and/or staff 

- Reconstituted and Converted: existing district-run 
school was reconstituted with a new administration 
and/or staff and converted to charted status at the 
same time 


Genesis 


Years in ere Number of years the school has been in operation in 
: Quantitative é : ae 
Operation its current instantiation 
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Use of Technology 


Schools vary greatly in the degree to which technology is integrated into the school day. In some schools, 
technology is nonexistent; in others, technology exists but is only rudimentary (i.e., Web, email, etc.). 
In some newer learning environments, however, technology is central to student learning. In such 
environments, students may do some or most of their work remotely and communicate with teachers 
and other students using videoconferencing or groupware technologies. Student work can be created, 
managed, shared and graded using workflow and project-management software, and students can 
utilize authoring tools to create multimedia presentations and project summaries. Students may also 
have access to audio and video technology for projects related to performing arts or journalism. Thus, it is 
critical to consider not only the type of technology in the school, but also the amount of time a student may 
spend interacting with technology during an average school day. The variables are presented below in 
Table 15. 


Table 15 Technology-related Variables 


Relevant 


Variable Type Description References 


Student- 


._ | Quantitative Number of students for every computer 
Computer Ratio 


1. Web: Whether a student has regular contact 
with the World Wide Web (yes/no) 

2. C.1: Whether a student has access to comput- 
er-based instruction (yes/no) 

3. Authoring: Whether a student has access to 


Chou & Liu, 
2005; Ruthven, 
Hennessy, & 


has os Dichotomous (5) Web authoring tools (yes/no) Se 
Sey 4. Groupware/workflow: Whether a student inter- Tine Cliffel : 
acts with teachers and/or other students using Nath & Secon 
groupware or workflow technology (yes/no) 2005 yr 
5. Audio/video: Whether a student has access to 

audio and/or video technology (yes/no) 

Teoh Percent of student time spent working directly ee ce aes 

Technology Quantitative with technology or hours/days/weeks working fick ala 2001 


directly with technology per day/week/year 
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Support Services 


Schools can be compared based upon the number and type of support services that are provided. These 
services can positively influence student performance and can include a dedicated school counselor or 
psychologist, social worker, community liaison, nurse, or a parental education, student tutoring, or hot 
lunch program. The variables are presented below in Table 16. 


Table 16 Support Service-related Variables 


a Relevant 
Variable Type Description 
yp P References 
School Quantitative Ratio of counselors to students 
Counselor 
School rae : ; 
, Quantitative Ratio of psychologists to students 
Psychologist 
Social Worker Quantitative Ratio of social workers to students 
School Nurse Quantitative Ratio of nurses to students 
Community ae : Be 
BS, Quantitative Ratio of liaisons to students 

Liaison 
Parental Die hotoateae - Yes: School provides this service 
Education - No: School does not provide this service 
Tutoring Wiehoton - Yes: School provides this service 
Program Cees - No: School does not provide this service 

; - Yes: School provides this service 
Hot Lunch Dichotomous - No: School does not provide this service 
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Other Variables 


Facility or resource-related variables that are traditionally used in school evaluation include school size 
(either in terms of number of students or number of teachers, or both), grade configuration, and location 
(i.e., rural, urban, suburban, etc.). The variables are presented below in Table 17. 


Table 17 Other Facility-related Variables 


: nee Relevant 
Variable Type Description eps eccee 
- Number of teachers and/or students Anderman, 2002; 
Bryk & Thum, 
1989; Lee, Bryk, & 
School Size Quantitative Smith, 1993; Lee & 
Smith, 1995; Rum- 
berger & Thomas, 
2000 
- Typical grade configurations could include K-5, Anderman & 
Grade C ica] K-6, 6-8, 7-9, 6-12, 7-12, 9-12, 10-12, or K-12. Kimweli, 1997; An- 
Configuration ee derman & Maehr, 
1994 
iGeationd Categorical - Typical school locations could include urban, Sirin, 2005 
suburban, rural, or medium-sized town. 
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Not Yet Included 


There are some key characteristics of schools that are not yet explicitly 
included in our framework for various reasons. A characteristic may be 
difficult to measure according to what we understand that the current 
time, or we may be undecided about whether the characteristic is 
inside or outside of our scope. 


Difficult to Measure 


Some characteristics of schools may have very strong impact on student outcomes but may be difficult 
to measure using existing approaches: 


Quality of Leadership: The “quality” of leadership in a school can play a large role in a school’s 
success (e.g., Blase, 1987), but how exactly can the “quality” of school leadership be defined and 
measured objectively? 


Quality of Oversight: The success or failure of a chartered school can depend in large part on the 
“quality” of the oversight provided by the charter sponsor or authorizer (e.g., NACSA, 2005), but 
again, how exactly can “quality” be defined and measured objectively? 


Rigorous Curriculum: Some research purports to demonstrate that a rigorous, intellectually 
demanding curriculum can lead to greater student achievement (e.g., Lee, Croninger, & Smith, 
1997). However, can the “rigor” of a curriculum be measured by examining the schools’ class of- 
ferings? Can it be determined by how many students enroll for more demanding courses? What is 
the mechanism in a school that sorts students into classes? Can this be captured and measured? 
Is the dropout rate a significant confound? In other words, does a demanding curriculum succeed 
because it forces the academically challenged students to drop out more quickly, thus raising the 
average test scores across the student body (e.g., Rumberger & Palardy, 2005)? 


Alignment: The alignment of the school curriculum with the state tests (and the state standards) is 
believed to impact student achievement (e.g., EdSource, 2006). How can “alignment” be measured? 
Or, is it more accurate to say that the key factor is the alignment of the state test with the state 
standards, making this a state issue and not a school issue? 


Coherence: The coherence of the school curriculum across grade levels is believed to impact student 
achievement (e.g., EdSource, 2006), but how can “coherence” be measured? In addition, if curricular 
decisions are made outside of a school, is this really a school issue? 


Out of Scope 


Some characteristics of schools may not belong within the framework given our stated scope: 


School Culture: School culture is considered by some researchers as a vital component of student success 
(e.g., DeWit et al., 2000; Van Houtte, 2005). However, there is no common approach to measuring this 
concept, and there could be a valid disagreement over whether this characteristic is part of the structure 
and operation of a school. For example, is a “school culture” something that is designed into a school’s 
structure and operation, or is it the result of a school’s structure and operation? Would it be more 
appropriate to consider school culture to be an outcome rather than a design feature? 


High Expectations: Research has shown that high expectations in a school can impact student outcomes 
(e.g., Gill, Ashton, & Algina, 2004; Lee & Smith, 1999; Middleton & Midgley, 2002; Phillips, 1997), but once 
again, is this characteristic of a school something that is designed into a school’s structure and operation, 
or is it the result of a school’s structure and operation? Does it result, for example, from the “quality of 
leadership’? 


Quality of Teaching: Student learning oftentimes depends on the quality of the teaching provided in the 
school (e.g., Rivkin, Hanushek, & Kain, 2005). However, is “quality of teaching” part of the structure and 
operations of a school? Or, is there something that a school does that encourages quality teaching, such 
as regular professional development, or teacher coaching or mentoring for young teachers? Our interest, 
in this case, would be to capture the aspects of school operations that encourage “quality teaching”. 


Student Population: The makeup of the student population has been shown to affect the level of student 
achievement in a school (e.g., Rumberger & Willms, 1992). However, can we consider student variables 
to be part of the structure and operations of a school? As with “quality of teaching”, is there something 
that a school is or does to attract a certain type of student population? If so, then our framework should 
capture these variables, and we should consider the makeup of the student population to be an outcome. 
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Conclusions 


Implications 

Given the current focus on school evaluation and 
accountability, it is vitally important to consider those 
differences among schools that can be expected to 
contribute to student behavioral, emotional, and ac- 
ademic outcomes. The current practice of comparing 
“district vs. charter” schools or “public vs. private” 
schools obscures the more important differences that 
such schools may have and does not provide a basis 
for substantive conclusions. 

Scientists involved in research on school perfor- 
mance would be well-advised to probe more deeply 
into school pedagogy, administration, and facilities in 
order to isolate those factors that truly contribute to 
students’ behavioral, emotional and academic out- 
comes. The framework presented here can serve as a 
starting point in this effort. 

Foundations interested in con- 
tributing to a more profound un- 
derstanding of schools and school- 
ing should, first and foremost, 
decline to fund further research 
in this field that does not take into 
account the more important dif- 
ferences among schools. After a 
decade or more of research on 
chartered schools, we are no clos- 
er to understanding whether char- 
tered schools as a group are suc- 
cessful, and if so, the key features 
of chartered schools that contrib- 
ute to their success. Further investment in this type of 
research is not warranted; rather, a new approach is 
required that is willing to look deeper into schools and 
discover the myriad ways they differ. Research of this 
nature should be aggressively pursued. 

Finally, policymakers should be wary of basing 
any decision-making on research that ignores the key 
features of schools in favor of an overly-simplistic for- 
mula for comparing schools that has not served us 
well. Before any new legislation is considered that is 
aimed at either promoting or discouraging the growth 
of chartered schools, a deeper understanding of these 


schools should be sought. In this effort, it is hoped that 
the framework presented here can serve as a first step. 


Next Steps 

In the current phase of the project, we are at- 
tempting to catalogue differences in schools that 
could be expected to impact student outcomes. In 
this process, we rely on existing research as well as 
direct observations in schools to identify compo- 
nents of this framework. To develop a taxonomy, 
however, we must describe large numbers of schools 
using this framework; following this, we will utilize 
clustering software to group the schools into classes 
(Bailey, 1994). 

Thus, unlike a typology which is essentially theo- 
retical in nature (e.g., Carpenter, 2006), our taxonomy 


It is vitally important to consider those 
differences among schools that can be ex- 
pected to contribute to student behavioral, 
emotional, and academic outcomes. The 
current practice of comparing “district 
vs. charter’ schools or “public vs. private” 
schools obscures the more important 
differences that such schools may have. 


will be empirical. In other words, our taxonomy for 
schools will be driven by a quantitative analysis of the 
data we collect, resulting in a classification system that 
is both more detailed and more grounded in reality, 
and, ideally, more useful for researchers, policymak- 
ers, and grantmakers. 

Finally, we hope that the research community will 
take up the challenge discussed in this paper and con- 
tinue to refine the school taxonomy over time. In the 
effort to fully comprehend educational innovation and 
its impact on students, a properly defined taxonomy 
is critical. 
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APPENDIX: List of Categories, Subcategories, and Variables 


1. Learning Model 
a. Curriculum 


i. Amount of Structure (Categorical; see pg. 9) 


ii. Course Offerings (Dichotomous; see pg. 10) 
iii, Authentic Pedagogy (Dichotomous; see pg. 10) 


iv. Common Planning Time (Quantitative; see pg. 10) 
v. Curricular Themes (Dichotomous; see pg. 10) 


Vv 


i. Individual Learning Plan (Dichotomous; see pg. 10) 


ii. Pace (Dichotomous; see pg. 10) 


sessment of Learning 
i. Grades (Categorical; see pg. 11) 


ii. Performance Assessments (Categorical; see pg. 11) 
iii. Student Reflection (Dichotomous; see pg. 11) 


c. Place and Time 


i. Place (Quantitative; see pg. 12) 
i. Learning Time (Quantitative; see pg. 12) 
i. Daily Schedule (Categorical; see pg. 12) 


d. Teacher-to-student Programs 


i. Advisory Grouping (Categorical; see pg. 13) 
i. Looping (Dichotomous; see pg. 13) 


e. Student-to-student Programs 


f. Ot 


ii 


i. Student Tutoring Program (Dichotomous; see pg. 14) 
i. Student Mentoring Program (Dichotomous; see 
pg. 14) 

i. Student Conflict Resolution Program (Dichoto- 
mous; see pg. 14) 

her Variables 

i. AP/IB Offerings (Quantitative; see pg. 15) 

i. Ability Grouping (Dichotomous; see pg. 15) 

i. Cooperative Learning (Dichotomous; see pg. 15) 


iv. Arts Focus (Dichotomous; see pg. 15) 
v. Cultural Focus (Dichotomous; see pg. 15) 


yi 


2. Admin 
a. Sc 


. Multi-lingualism (Dichotomous; see pg. 15) 
istration 

hool Management 

i. External Affiliation (Categorical; see pg. 17) 

i. School Autonomy (Dichotomous; see pg. 17) 
i. School Leadership (Categorical; see pg. 17) 


b. Teacher Development 


i. Professional Development (Quantitative/Dichot- 
omous; see pg. 18) 

i. Coaching/ Mentoring Program (Dichotomous; 
see pg. 18) 

i. Evaluation (Dichotomous; see pg. 18) 


iv. Teacher Pay (Dichotomous; see pg. 18) 


c. Student Involvement 


. Creation of Rules (Categorical; see pg. 19) 
i. Student Court (Dichotomous; see pg. 19) 


iii. Budget (Dichotomous; see pg. 19) 


iv. Staffing (Dichotomous; see pg. 19) 


d. Parent Involvement 


i. Parental Compact - Volunteer (Dichotomous; see 
pg. 20) 

ii. Parental Compact - Homework (Dichotomous; 
see pg. 20) 

iii. Parental Compact - Discipline (Dichotomous; 
see pg. 20) 

iv. Parental Contact (Quantitative; see pg. 20) 

e. Measuring Success 


vi. 


. Attendance (Dichotomous; see pg. 21) 


ii. Graduate Rate 
iii. Disciplinary Referrals (Dichotomous; see pg. 21) 
iv. School Safety (Dichotomous; see pg. 21) 


. Parent Satisfaction (Dichotomous; see pg. 21) 
Fiscal Soundness (Dichotomous; see pg. 21) 


f. Other Variables 
i. School Finances (Quantitative; see pg. 22) 
ii. Staff Size (Quantitative; see pg. 22) 


Vv. 
vi 


i. Teacher Qualifications (Quantitative; see pg. 22) 


. School-Community Partnerships (Dichotomous; 
see pg. 22) 

. Admissions Policy (Categorical; see pg. 23) 

. School Uniforms (Dichotomous; see pg. 23) 


3. Facilities and Resources 
a. School Building 


. Configuration (Dichotomous; see pg. 25) 
. Occupancy (Dichotomous; see pg. 25) 
. Ownership (Dichotomous; see pg. 25) 


b. School Status 


. School Genesis (Categorical; see pg. 26) 
. Years in Operation (Quantitative; see pg. 26) 


c. Use of Technology 


. Student-Computer Ratio (Quantitative; see pg. 27) 
. Type of Technology (Dichotomous; see pg. 27) 
. Time with Technology (Quantitative; see pg. 27) 


d. Support Services 


vil. 
viii. 


. School Counselor (Quantitative; see pg. 28) 


i. School Psychologist (Quantitative; see pg. 28) 
iii. Social Worker (Quantitative; see pg. 28) 
iv. School Nurse (Quantitative; see pg. 28) 


. Community Liaison (Quantitative; see pg. 28) 


i. Parental Education (Dichotomous; see pg. 28) 


Tutoring Program (Dichotomous; see pg. 28) 
Hot Lunch (Dichotomous; see pg. 28) 


e. Other Variables 


. School Size (Quantitative; see pg. 29) 
. Grade Configuration (Categorical; see pg. 29) 
. Location (Categorical; see pg. 29) 


4. Not Yet Included 
a. Difficult to Measure 


b. Ou 


t of Scope 
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